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Chapter 1: Introduction 

Motivation 
Research Goals 
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• Spacecraft components may be damaged due to airflow produced 
by Environmental Control Systems (ECS). 

• Spacecraft must survive both pre-launch and launch environments 

• ECS Systems supply air to keep spacecraft cool, dry, clean while on 
the ground 

• Delicate spacecraft instruments are sensitive to high velocity flow 
from ECS system 

- Manufactures set Impingement Requirements 

• (2) Methods to Verify Requirements 

- Test vs. CFD 


#UCF 


University oi Central, Florida 


COLLEGE OF ENGINEERING AND COMF1 TEH SCIENCE 



Motivation: ECS System 
Overview 



JOHN F KENNEOY SPACE CENTER 


LAUNCH SERVICES PI 

L / 


• Environmental Control System 

— Prior to launch, cold air (air conditioning) flows 
downward around the spacecraft after it has been 
encapsulated in the Payload Fairing. 

— The cold air is delivered through an air-conditioning 
(AC) pipe, which intersects the fairing and flows past a 
diffuser located at the pipe/fairing interface 

— After passing over the spacecraft, it is finally 
discharged through vents 

— The Payload Fairing air conditioning is cut off at lift off. 
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• Example of ECS CFD Analysis 


AC pipe 
Diffuser 


\ 


DPAF 

/ Guidance section 

/ « 



Swirl flow 
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• Example of an ECS system airflow test 
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• Computational Fluid Dynamics (CFD) is being used without proper 
validation 

• "There can be no validation without experimental data with which to 
compare the results of the simulation" - Coleman and Stern 

• Experimental Data is expensive 

- Shrinking Budgets 

• Pairing experimental data, uncertainty analysis, and analytical predictions 
provides a comprehensive approach to verification and is the current state 
of the art. (ASME V&V 20-2009) 

• A method is sought to conservatively envelop the exact solution using CFD 
only 

- Without Experimental Data 
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STANDARD FOR MODELS AND SIMULATIONS 
Requirement 4.4.7 & 4.4.8 

• Shall document any uncertainty quantification processes 
used for: 

• Shall document any quantified uncertainties, both physical 
and numerical, for: 

a. The referent data 

b. The input data 

c. The Modeling and Simulation (M&S) results 

d. The propagation of uncertainties 

e. The quantities derived from M&S results 
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1. Demonstrate a CFD Uncertainty Analysis for 3-D, low speed, 
incompressible, highly turbulent, internal flow can be calculated for an 
entire simulation domain 

2. Investigate a higher order interpolation scheme to be used for grid 
interpolations and uncertainty quantification 

3. Investigate the applicability of using the ASME 5-Step procedure for the 
entire computational domain to estimate numerical uncertainties. 

4. Calculate the uncertainty in using different turbulent models. 

5. Demonstrate this method can contribute to the study of importance of 
input parameters in CFD. 

6. Compile a table for uncertainty estimates by input parameter. 

7. Demonstrate the ability to use OPENFOAM to calculate the velocity field 
of an Environmental Control System. 

8. Compare the results of OPENFOAM verses an industry standard CFD 
software program (ie FLUENT and STARCCM+). 
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Chapter 2: Literature Review 



Summary of Literature Review 
Summary of the State of the Art 

Uncertainty Analysis 
Proposed Methodology without 

Test Data 
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Summary of ASME Standard 


ASME V&V-20-2009 

Standard for Verification and 
Validation in Computational Fluid 
Dynamics and Heat Transfer 
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Approach 



Estimate Interval within which 6 model falls with 
a given degree of confidence 

E model ^-val’E Upali 


E = S — D 


• Error Sources (U num, Uinput, Ud), Uncertainty 
Equation 


V-val k ^ f 


Unum ^ input ^ 


D 
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• 5 Step Procedure for Uncertainty Estimation 


- Step 1: Representative Grid Size 


h 


1 


Total Volume 

total number of cells in fine grid 


i 

3 


h 2 

h 3 


Total Volume 


total number of cells in medium grid 

Total Volume 


Total number of cells in coarse grid. 


i 

3 
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- Step 2: Select 3 significantly (r>1.3) different grid 


sizes 


h- 


r 2 i = 


K 


h. 


r 32 = 


h- 


— Use CFD Simulation to analyze key variables, Sk 


#>UCF 

University' of Central Florida 


£ 21 “ ^k2 \l 
£ 32 = ^k3 “ ^k2 


COLLEGE OF ENGINEERING AND COMPUTER SCIENCE 


jj ^^ Numerical Uncertainty, U num 



JOHN f KENNEDY SPACE CENTER 



LAUNCH SERVICES P 


- Step 3: Calculate observed order, p 


p = 


Un(r 21 )J 


* [In I — 1 + In 


r V 
'21 


sign © 


^21 


r 32 p ~ 


sign (f^) 


- Step 4: Calculate extrapolated values 


21 


'ext 


( r 2 1 P * S kl S k2 ) 

(>21 P “ 1) 


p 21 _ 
c a 


($k 1 — Sk2) 

(S k i) 
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- Step 5: Calculate Fine Grid Convergence Index & 
Numerical Uncertainty, Factor of Safety, Fs=1.25 


m 21 — * e “ 21 

fine (r 21 P - 1) 


- Assumption that the distribution is Gaussian about the fine grid, 90% 
Confidence 

_ GCIfine 21 

U num o 
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• Input error is based on a Taylor Series 
expansion in parameter space 


^ input 
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Proposed Methodology without Test 

Data 
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Without Experimental Data 11 Jc 


Proposed Methodology ** conservative estimate to envelop true value 

If there is no experimental data, D=0, 5 D =0, and u D =0. 

E = S — D = S 

8s = S-T 

E = S — D = T + 8s — (T + 8i )) = 8$ — 8 q = 8$ 
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(J 



Report the simulated result, S as 
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Without Experimental Data -continued 
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Report S +/-u s 

k - value (Use Student-t 
Distribution) 

Treat all input variables 
as 'random' and run 
separate CFD case 

Treat as an oscillatory 
convergence parameter 


u 


Oscillatory 


2 ($u S L ) 
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Number of Cases 

Degrees of Freedom 

Confidence 90% 

! 2 

1 

6314 

3 

2 

2.92 

4 

3 

2.353 

5 

4 

2.132 

6 ! 

5 

2.015 

7 

6 

1.943 

8 

7 

1.895 

9 

8 

1.86 

P 10 

9 

1.833 

] 11 

10 

1.812 

12 

11 

1.796 

13 i 

12 

1.782 

j 14 

13 

1.771 

15 

14 

1.761 

16 

15 

1.753 

17 

16 

1.746 

18 

17 

1.74 

19 

18 

1.734 

20 

19 

1.729 

! 21 

20 

1.725 

22 

21 

1.721 

23 

22 

1.717 

1 24 

23 

1.714 

25 

24 

1.711 

26 

25 

1.708 

27 

26 

1.706 

28 

27 

1.703 

29 

28 

1.701 

30 

29 

1.699 

j 31 

30 

1.697 

41 

40 

1.684 

51 

50 

1.676 

j 61 

60 ^ 

1.671 

81 

80 

1.664 

101 

100 

1.66 

121 | 

120 

1.658 

infty 

infty 

1.645 
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Chapter 3: Applying the State of the 
Art CFD Uncertainty Analysis to a 
Backward Facing Step 


Grid Refinement Study 
CFD Uncertainty Analysis of 
Backward Facing Step 
Results and Discussion 
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Backward Facing Step Example 

AIAA-2013-0258 
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Velocity Magnitude Prediction - Backward 

Facing Step 

LAUNCH SERVIC 


ward/ 1 

Jr£ 

LAUNCH SERVICES PJOSRAM I 


Uniform Velocity Inlet 
U= 10 m/s 


Symmetry 


R 11 .00 

9.90 

8.80 

■ 7.70 

■ 6.60 

5.50 

■- 4 40 

• 3.30 

2.20 

h 1.10 

0.00 
[m s A -1] 



Pressure Outlet 
Pgage = 0 
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Uncertainty Variables ke-realizabk 
(OPENFOAM - SimpleFoam) 
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• There are 87 Different Input Parameters for the 
ke-realizable model in SimpleFoam 

— These include: 

• Boundary Conditions 

• Wall Functions 

• Fluid Properties 

• Turbulence Parameters 

• Solution Schemes 

• Solvers 

• Mesh 

• ect. 
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Uncertainty Variables Considered 
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Type of Variable 

Variables Xi 

Value 

Bias Error 

Boundary 

Conditions 

epsilion turbulent mixing length dissipation rate inlet (m2/s3) 

0.5 

0.5 


k turbulent intensity kinetic energy inlet (m2/s2) 

0.05 

0.05 


pressure outlet (Pa) 

101325 

2% 


velocity inlet (m/s) 

10 

0.5 

Fluid Properties 

kinematic viscosity nu represents air [0-50-100] deg C 

1.79E-06 

[13.6e-06 -> 23.06e- 
06] 

Grid Size 

Method - Uses Oscillatory Uncertainty 

1,192,000 

1,862,500 

3,311,689 


Numerical 

Method - Uses Richardson's Extrapolation (ASME 5 Step Procedure) - Calculated for Velocity at each 

Cell 

Solver 

OpenFOAM (SimpleFoam) vs. Fluent 



Turbulence 

Models 

ke-realiable, kwSST, and SpalartAllmaras 
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Expanding the data reduction equation for the listed variables in order from top 
to bottom. 




Oscillatory Variables 
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• The uncertainty for each of the following was calculated for each 
cell using the following method outlined by Stern, Wilson, Coleman, 
and Paterson. S is the simulated result. For this case it is the upper 
velocity S^and the lower velocity S L . 

- epsilion turbulent mixing length dissipation rate inlet (m 2 /s 3 ) 

- k turbulent intensity kinetic energy inlet (m 2 /s 2 ) 

- Pressure outlet (Pa) 

— Velocity Inlet (m/s) 

— Kinematic viscosity nu=17.06e-06 [13.6e-06 -> 23.06e-06l (m 2 / 
s) represents air [0-50-1001 degrees C 

— Grid size 

— Turbulence Models 

— Solver 
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epsilion turbulent mixing 
length dissipation rate 
inlet (m 2 /s 3 ) 



k turbulent intensity 
kinetic energy inlet (m 2 / 

sil 


0-0.785 percent 
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Results (Oscillatory Variables) 


Pressure outlet (Pa) 

0-20 percent 



Kinematic viscosity 
nu=17.06e-06 fl3.6e-06 -> 
23.06e-061 (m 2 /s) represents 
air r0-50-1001 degrees C 

0 - 27.727 percent 



|,m 
“ 600 # 



Turbulence Models 

> 100 % 



Velocity Inlet (m/s) 

0 - 6.558 percent 



Grid size 

0 - 698 percent 



f 10.00 

I 5.00 

I 0.00 


Solver 

> 30 % 



Percent - is the percentage change in local velocity 
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Results (Monotonic 
Convergence! 
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Numerical - ASME V&V-20-2009 5 Step Procedure 


For a grid size of 1,192,000 cells [grid 2 -1,862,500 
cells], [grid3 - 3,311,689 cells], the uncertainty in 
the velocity prediction was 0 - 5300 percent as 
shown in Figure 11 as estimated by Richardson's 
extrapolation method. 
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Velocity Prediction with Uncertainty 

LAUNCH SERVICES PK&RAM | 



Uncertainity in Velocity (Uvel) -*7- [m/s] 

■ 2.45 

■ 2.30 
2 .14 

\ 1.99 
1.84 
1.68 
1.53 
1.38 

: T22 


UCF 


1.07 

0.92 

0.77 

0.61 

0.46 

0.31 

0.15 

0.00 
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The highest uncertainty is +/- 4.85 m/s. 
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onclusion of AIAA-2013-0258/^ 

4TER JL ) 
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This paper outlines an uncertainty analysis for the 
realizable turbulence model for a backward facing 
step. 

The velocity magnitude was predicted using CFD. 



• The uncertainty parameters listed in the Table were 
analyzed using an oscillatory convergence calculation 
or a monotonic convergence calculation. 

• Plots of the velocity magnitude can be combined with 
a corresponding uncertainty plot for an accurate 
velocity prediction. 

• Numerical Uncertainty using ASME 5 Step Procedure 
produced un-realistic results 
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Conclusion /Recommendation 
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The following input uncertainty's are recommended 



LAUNCH SERVICES PI 


Type of 
Variable 

Variables Xi 

Value 

Bias Error 

Uncertainly 

Boundary 

Conditions 

epsilion turbulent mixing length dissipation rate inlet (m2/s3) 

0.5 

0.5 

1.2% of local velocity 


k turbulent intensity kinetic energy inlet (m2/s2) 

0.05 

0.05 

0.8 % of local velocity 


pressure outlet (Pa) 

101325 

2% 

lOx the variation 


velocity inlet (m/s) 

10 

0.5 

1.3x the variation 

Fluid 

Properties 

kinematic viscosity nu represents air [0-50-100] deg C 

1.79E-06 

[13.6e-06 -> 
23.06e-06] 

28% of the local velocity 

Grid Size 

Method - Uses Oscillatory Uncertainty 

1,192,000 

1,862,500 


grid specific 

3,311,689 


Numerical 

Method - Uses Richardson's Extrapolation (ASME 5 Step 
Procedure) - Calculated for Velocity at each Cell 



Solver 

OpenFOAM (SimpleFoam) vs. Fluent 



30% of the local velocity 

Turbulence 

Models 

ke-realiable, kwSST, and SpalartAllmaras 



Future work will 
consider more 
turbulence models 
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Chapter 4: Spacecraft ECS System^ 
Overview and Modeling 

Publically Available Information 

on EELV ECS Systems 
Modeling and CFD Analysis of (3) 
Generic Non-proprietary 


Environmental Control Systems 
#> ucf and Spacecraft Configurations 

University of Central Florida 
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Spacecraft / ECS System 
AIAA-2014-0440 
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• The Rockets Behind the Missions: 

- Delta II 

- Delta IV 

- Atlas V 

- Pegasus 
— Taurus 

- Falcon 9 

• http://www.nasa.gov/centers/kennedv/ 
launchingrockets/ 
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Public Available 



• Each of these vehicles have a Payload Planners Guide or Users Guide 

• http://www.ulalaunch.com/site/docs/product cards/guides/ 
DeltallPayloadPlannersGuide2007.pdf 

• http://www.ulalaunch.com/site/docs/product cards/guides/ 
DeltalVPayloadPlannersGuide2007.pdf 

• http://www.ulalaunch.com/site/docs/product cards/guides/ 
AtlasVUsersGuide2010.pdf 

• http://www.orbital.com/Newslnfo/Publications/Pegasus UG.pdf 

• http://www.orbital.com/Newslnfo/Publications/taurus-user-guide.pdf 

• http://www.spacex.com/Falcon9UsersGuide 2009.pdf 
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Delta II 
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• Air-conditioning is supplied to the spacecraft via an umbilical after 
the payload fairing is mated to the launch vehicle. 

• The payload air-distribution system provides air at the required 
temperature, relative humidity, and flow rate as measured 

• The air-distribution system uses a diffuser on the inlet air- 
conditioning duct at the fairing interface. 

• If required, a deflector can be installed on the inlet to direct the 
airflow away from sensitive spacecraft components 

• The air can be supplied to the payload between a rate of 

• 1300 to 1700 scfm. 

• Diameter of Fairing is 3meters 
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http://www.ulalaunch.com/site/docs/product cards/guides/ 
DeltallPayloadPlannersGuide2007.pdf 
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• The air is supplied to the payload at a maximum 
flow rate of 36.3 kg/min to 72.6 kg/min (80 to 
160 Ib/min) for 4-m fairing launch vehicles and 
90.7 kg/min to 136.0 kg/min (200 to 300 Ib/min) 
for 5-m fairing launch vehicles. 

• Air flows around the payload and is discharged 
through vents in the aft end of the fairing. 

• Fairing sizes 4meter and 5 meters in diameter 
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Atlas V 
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• Internal ducting defectors in the PLF direct the gas upward to prevent direct 
impingement on the spacecraft. 

• The conditioning gas is vented to the atmosphere through one-way flapper doors 
below the spacecraft. 

• The PLF air distribution system will provide a maximum air flow velocity in all 
directions of no more than 9.75 mps (32 fps) for the Atlas V 400 and 10.67 mps (35 
fps) for the Atlas V 500. 

• There will be localized areas of higher flow velocity at, near, or associated with the 
air conditioning outlet. 

• Maximum air flow velocities correspond to maximum inlet mass flow rates. 

• Reduced flow velocities are achievable using lower inlet mass flow rates. 

• Flow Rates 

A) Atlas V 400: 0.38-1.21 kg/s ±0.038 kg/s (50-160 Ib/min ±5 Ib/min), 

B) Atlas V 500: 0.38-2.27 kg/s ±0.095 kg/s (50-300 Ib/min ±12.5 Ib/min) 

• Fairing sizes are 4meters and 5 meters in diameter 
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Pegasus 
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• The fairing is continuously purged with filtered 


• The flowrate of air through the fairing is 
maintained between 50 and 200 cfm. 

• The air flow enters the fairing forward of the 
payload and exits aft of the payload. There are 
baffles on the inlet that minimize the 
impingement velocity of the air on the payload. 

• Fairing diameter is 0.97 meters 


air. 
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http://www.orbital.com/Newslnfo/Publications/ 
Pegasus UG.pdf 



• Upon encapsulation within the fairing and for 
the remainder of ground operations, the 
payload environment will be maintained by 
the Taurus Environmental Control System 
(ECS). 

• Fairing inlet conditions are selected by the 
Customer 


• Fairing diameters are 63 inches and 92 inches 
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http://www.orbital.com/Newslnfo/Publications/ 

taurus-user-guide.pdf 
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Falcon 9 



• Once fully encapsulated and horizontal, the 
Environmental Control System (ECS) is 
connected 


• Payload environments during various 
processing phases are: 

— In hanger, encapsulated - Flow Rate: 1,000 cfm 
— During rollout: 1,000 cfm 
— On pad: Variable from 1000 to 4500 cfm 


• Fairing diameter is 5.2 meters 
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http://www.spacex.com/Falcon9UsersGuide 2009.pdf 
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(3) Configurations ^ > 
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• Fairing Sizes are approximately lm, 1.6m, 2.3m, 3m, 
4m, 5m in diameter. 

• (3) generic fairing diameters are selected to envelop 
the EELV fairing configurations 

- 0.75m 

- 3.5 m 

- 5.5 m 

• Inlet Conditions range from 1000 cfm to 4500 cfm 

• Spacecraft diameters range with fairing sizes, a generic 
spacecraft was drawn and scaled accordingly 
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• CAD model of the spacecraft was created in 
Pro/ENGINEER, 0.75m 
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(3) Configurations 
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• Snappy Hex - Mesher 


0.75m 
Configurate 
(6762865 number 
of cells) 
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3.5m Configuration 
(8594480 number of 
cells) 



5.5m Configuration 
(6980673number of 
cells) 
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• OpenFoam - SimpleFoam 


o ne_coa rseg r id (m/sl 



0.75m 
Configuratil 
(6762865 number 
of cells) 



one_coarsegrid (m/s) 
10 


r 


20 


10 


i 

0 
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3.5m Configuration 
(8594480 number of 
cells) 


5.5m Configuration 
(6980673number of 
cells) 
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Chapter 5: Computational Fluid 
Dynamics Uncertainty Analysis 


Interpolation Scheme needed for CFD Uncertainty Analysis 

Feasibility of using Richardson's 

Extrapolation for Entire Computational 
Domain 

Proposed CFD Uncertainty Method 

Compared to Exact Solution - Laminar 
Flow Between Parallel Plates 
Proposed CFD Uncertainty Method Applied to 

Fleat Transfer over a Flat Plate 
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Interpolation Method needed for 
Numerical Uncertainty Analysis of 
Computational Fluid Dynamics 


AIAA-2014-1433 
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• Navier Stokes Equations 

— 2 nd order, non-homogeneous, non-linear partial 
differential equations 


• Richardson's Extrapolation is used to produce 
4 th order accurate solution from separate 2 nd 
order accurate Navier Stokes Solutions 
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• ASME V&V 20-2009 Outlines a 5-step Procedure 
to Richardson's Extrapolation using Roache's 
(1998) Grid Convergence Index (GCI) Method 


• Assumptions 

1. Three discrete solutions are in the asymptotic range 

2. Meshes have a uniform spacing over the domain 

3. Meshes are related through systematic refinement 

4. Solutions are smooth 

5. Other sources of numerical error are small 
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Solver Interpolation ^ 
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• FLUENT 

• Includes a Mesh-to-Mesh Interpolation 

• Performs a zeroth-order (nearest neighbor) interpolation 

• Designed for initial conditions from a previous solution 

• OPENFOAM 

• Mapfields fuction interpolation 

• Used for initialization of a solution from a previous model 

• Using these 'zeroth-order' interpolation schemes is not 
sufficient for comparing errors from the mesh 
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Matlab Interpolation Schemes 



• Matlab 

• High level language used for numerical computations 

• CFD data is in various forms 


• ID, 2D, 3D, uniform, non-uniform 

• Generic Scheme is sought for all CFD data 

Matlab Function 

interpl interp2 interp3 

Interpolation Method 
'nearest' - Nearest neighbor interpolation 
'linear' - Linear interpolation (default) 

'spline' - Cubic spline interpolation 
'pchip' - Piecewise cubic Hermite interpolation 
'cubic' 

'v5cubic' - cubic interpolation used in Matlab 5 


X 

X 

X 

X 

X 

X 

X 

X 

X 

X 



X 

X (uniformly-spaced only) 

X (uniformly-spaced only) 

X 
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- Fully developed flow between parallel plates 

• Exact Solution to Navier Stokes 





Provide a good example of errors that can be induced 
from interpolation 


12/i \dx/ 



a 2 /3P\ 
U 2[i\dx) 


0 
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a (m) 

o.i 

rho (kg/m3) 

1.225 

mu (Ns/m2) 

0.00001789 

dp/dx (N/m3) 

-0.004 
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- Constructed a 
CFD Model in 
FLUENT 

• 3 Grids 

- Coarse, 7,140 
Cells 

- Medium, 14,186 
Cells 

- Fine, 24,780 
Cells 


CFD vs. Exact 



—EXACT 
• Coarse 
A Medium 
Fine 
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Example Problem 
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• Interpolation Direction? 






Interpolate Coarse and Medium Mesh -> Fine 



Interpolate Medium and Fine Mesh -> Coarse 



*2 


medium 
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1. Linearly Interpolate Coarse and Medium Mesh -> Fine 



LAUNCH SERVICES PI 



^2 


mediunr 









Max % Error 
Extrapolated 
Values 

Average % 
Error 

Extrapolated 

Values 

0.8950 

0.0596 
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Example Problem 
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2. Linearly Interpolate Fine and Medium Mesh -> Coarse 
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^2 


mediunr 









UsiVI HNirY « >1 ClM ICM I 'l l 


* 


— L- 


in 

CL 

n 

>3 







T 




















c 

oar 

se 






























tt 






Max % Error 
Extrapolated 
Values 

Average % 
Error 

Extrapolated 

Values 

0.0792 

0.0175 
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Example Problem 
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Interpolation Direction? 



LAUNCH SERVICES P 


1. Interpolate Coarse and Medium Mesh -> Fine 


p oi.ircd SclLitlcn mi F ire Grid 



^ E ■ ! i .ipnl.bl r :l %n-lu+ir>n. 

— Exact 


VrlaiTbtv I 


© 


2 J Interpolate Medium and Fine Mesh -> Coarse 


Extrapolated Solution on Ccanit Grid 


ejoe 
C 04C H5 

-Eh 

a- 

Si O 4> IEH3 
0.0] 00 


■ I lI i .igiril.Ll i- :l '-pt:- I ■ ■ -I v ■ i i 

—E siACT 
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DOOSO 0.0] t>0 0 01 SO 0.0300 0 0250 0.0300 

■J^-l-rn i l i,' [m/\ | 


Max % Error 
Extrapolated 
Values 

Average % Error 
Extrapolated 
Values 

0.8950 

0.0596 

> Coarse 

Max % Error 
Extrapolated 
Values 

Average % Error 
Extrapolated 
Values 

0.0792 

0.0175 
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Grids 

Max % Error 

Average % Error 

(Coarse vs Exact) 

0.1910 

0.1265 

(Medium vs Exact) 

0.0969 

0.0367 

(Fine vs Exact) 

0.0289 

0.0121 


1. Linearly Interpolated Coarse. Medium to Fine 


(Interpolated Coarse vs Exact) 

1.9760 

0.2528 

(Interpolated Medium vs Exact) 

0.6322 

0.0679 

2. Linearlv Interpolated Medium, Fine to Coarse 

(Interpolated Medium vs Exact) 

0.0728 

0.0362 

(Interpolated Fine vs Exact) 

0.0787 

0.0223 

Extrapolated 

1. Linear Interpolation Coarse and Medium to Fine (Extrapolated vs 

Exact) 

0.8950 

0.0596 

2. Linear Interpolation Medium and Fine to Coarse (Extrapolated vs 

Exact) 

0.0792 

0.0175 
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- Interpolating to the coarse grid was selected 

- Other interpolation methods 

• "nearest" - Fluent's Mesh-to-Mesh 


• "linear" - Matlab 

yfi = interpl(fine(:,2),fine(:,l),coarse(:,2), 'linear') 

• "cubic" - Matlab 

yfi = interpl(fine(:,2),fine(:,l),coarse(:,2)/cubic') 
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Example Problem 



• "nearest" 


- Fluent's Mesh-to-Mesh 
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// 


linear" 


Matlab 

yfi = interpl(fine(:,2),fine(:,l),coarse(:,2), 'linear') 




INivikniiy 01 Cimiui Fiokida 

COLLMiE OP ENGINEERING AND COMPUTE! SCIENCE 


65 


Example Problem 
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"cubic" 


- Matlab 

yfi = interpl(fine(:,2),fine(:,l),coarse(:,2)/cubic') 
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Matlab Interpolation Schemes 
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• Extending the Interpolation Schemes to 2D and 3D 

• Interp2 and Interp3 Matlab Functions 

• Require use of MeshGrid 


• Griddata Function 

• Nearest, Linear, Natural, Cubic, and v4 

• Nearest, Linear, and Natural are the only options available in 2D and 
3D 

• The only options available for ID, 2D, and 3D 

• Interpl and Griddata - 'nearest' 


Transforms the domain of vectors into arrays 
For Meshes in the 4 million to 8 million Cell Range 
• Error "Maximum variable size allowed by program is 


exceeded" 
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3D Example 



• Airflow around encapsulated spacecraft 

- Matlab griddata 'linear' option used 

- Interpolating Fine and Medium Grid onto Coarse 
Grid 
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3D Example 


• Comparing using a Line Plot 
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3D Example 



• Comparing using a Line Plot 



one_coarsegrld 

three_flnegrld 

1wo_medgrld 
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AIAA-2014-1433 Conclusion / 
Recommendation 
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• By comparing the interpolation schemes in one, two, and 
three dimensions and investigating the options that are 
readily available in Matlab 

• Recommend the "linear" option be used when comparing the 
error or uncertainty due to the grid 


• If coarse grid has the level of detail required 

• Recommend interpolating from the fine and medium grids onto 
the coarse grid 

• Lower Error in the Extrapolated Solution 

• Smaller Data Set 

— Future Work include higher order interpolation schemes 
in 3D (Radial Basis Function Interpolation, 4 th order) 


• interpl or griddata Matlab commands 
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Feasibility of using Richardson's 
Extrapolation for Entire Computational 

Domain 
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Summary of Method ^ 
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• Following method outlined by Stern, Wilson, Coleman, and Paterson 

• Convergence studies require a minimum of three solutions to evaluate 
convergence with respect to an input parameter. Consider the 
situation for 3 solutions corresponding to fine S kl , medium S k2 , and 
coarse S k3 values for the kth input parameter. Solution changes e for 
medium-fine and coarse-medium solutions and their ratio R k are 
defined by: 



Three convergence conditions are possible: 


Monotonic convergence: 0< R k <1 
Oscillatory convergence: R k < O' 
Divergence: R k >l 



UCF 


University of Central Florida 


73 


COLLEGE OF ENGINEERING AND COMPUTER SCIENCE 



JOHN f KENNEDY SPACE CENTER 


Results (Monotonic Convergence?) 
Backward Facing Step 


Three convergence conditions are possible: 

Monotonic convergence: 0< R k <1 
Oscillatory convergence: R k < O' 
Divergence: R k >l 
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(ii) - Cells with 
Oscillatory 
Convergence 
Rk<0 
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Results (Monotonic Convergence?) 
Spacecraft / ECS System 



LAUNCH SERVICES P 




Three convergence conditions are possible: 

Monotonic convergence: 0< R k <1 
Oscillatory convergence: R k < O' 
Divergence: R k >l 

Rk 


i0.5 

E 

i0.25 

■= 

I 
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Proposed CFD Uncertainty Method 

Compared to Exact Solution - 
Laminar Flow Between Parallel Plates 
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Example Fully Developed Laminar Flow 

between Parallel Plates 


LAUNCH SERVICES PI 


Heat Transfer Correlations, Traditional 


L 



• The uncertainty analysis will follow the methodology laid out by Coleman 
and Steele (Experimentation and Uncertainty Analysis for Engineers, 2 nd 
ed, J. Wiley and Sons, 1999). This methodology is in line with the ISO 
Guide to the Expression of Uncertainty in Measurement (1993). 


B - («-.(©' B '1 + 2 (@ © [BA] 


correlated 




V; 


Bias 


Correlated 


Random 



du 5 P 
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Example Fully Developed Laminar Flow 

between Parallel Plates 
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• Uncertainty for 5% Bias in pressure gradient 
and viscosity 




*y * (y - a)/(2[x) 
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xample Fully Developed Laminar Flow 
between Parallel Plates 


Numerically Evaluating (Traditional): 



Exact Solution with Uncertainty 



o m m tj.cns m om m mjs 

VelMlty jm/s) 


Uncertainty 



tl.OOl Q.DD1S 

Velocity Uocertiartty (ni/i[ 
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Proposed Methodology using CFD 
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CFD Uncertainty Cases 

Number of Cases 

Degrees of Freedom 

Confidence 90% 

1 

Coarse Grid 

> 

i 

6.314 

2 

Medium Grid 

3 

2 

2.92 

3 

Fine Grid 
Velocity Low 

4 

3 

2.353 

A 

5 

4 

2.132 

4 

6 

5 

2.015 

5 

Velocity High 

7 

6 

1.943 

6 

Density Low 
Density High 
Outlet Pressure Low 

8 

n 

1.895 

7 


8 

| 10 I 

9 

| 1.833 | 


9 0 

lutlet Pressure High 

12 

11 

1.796 

10 

Solver 

13 

12 

1.782 



14 

13 

1.771 


u vai = 1.833 




dV V 


\dvelocity 


■ 


ft 2 

u velocity 


((^pressure) ^P ressure ^j + + ^(drTio) ^ rft0 ) + ( dsolver ) ^ solver 
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Proposed Methodology using CFD Only, 

:enter ) 


Results for proposed methodology 
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iXACT 
ncert Low 
ncert High 
oarse iuluroi 
Tied EOlutlQrl 
i ne iol ution 
r let velocity It 
>nlet velocity h 
^res&ura lu'^ 
jresE.ur-5 high 
nu high 
IU low 


openFoam 
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Comparison 



• Traditional vs. Proposed 


Velocity 


Uncertainty 




CFD Uncert Hig h 


Uncertainty in 
£ 


■Exact 


■Exact -uncart l o.Oi 


■Exacts Uncert 
■Numerical uloi* 
“Numerical UhtgK 


CFD Uncert Low 


Uncertainty in 
Traditional Metho 


G.0005 C.OOl O.POLS 0.002 d.oois 0.00$ 


UCF 


University of Central Florida 


■Exact Uncert 
■CFD Uncert w/k Factor 


82 


COLLEGE OF ENGINEERING AND COMPUTER SCIENCE 



JOHN f KENNEDY SPACE CENTER 


Comparison of Methods jc 

« ~ : 


LAUNCH SERVICES PI 


Traditional vs. Proposed 
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onclusion Example Fully Developed 
kjSininar Flow between Parallel Plate^ 
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• Proposed Method Envelops the True value and uses 
only CFD Data to Estimate the Uncertainty for 
Laminar Flow between Parallel Plates 

- No Testing 


• Proposed methodology can be used to 
conservatively estimate the uncertainty in CFD 
models 
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Computational Fluid Dynamics 
Uncertainty Analysis applied to Heat 
Transfer over a Flat Plate 

APS-DFD13-2013-000087 
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xample Heat Transfer over Flat Plate, 

rNTER ) 


LAUNCH SERVICES PI 


Heat Transfer Correlations, Traditional 





• The uncertainty analysis will follow the methodology laid out by Coleman 
and Steele (Experimentation and Uncertainty Analysis for Engineers, 2 nd 
ed, J. Wiley and Sons, 1999). This methodology is in line with the ISO 
Guide to the Expression of Uncertainty in Measurement (1993). 
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correlated 


F s- {(£)>)) 


V; 


Bias 


Correlated 


Random 
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dh 

4ckp 

dh 

4CVkp 

dV ~ 


dp 


dh 

4ckV 

dh 

_ 4CVkp «(^) 1/5 

dp 

1 


dL 


dh 

C /LFp\ 4 / 5 

dh 

_ k ZpKL\ 4 / 5 

dk ~ 

L\pJ 

dC 

~ L\ p J 
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xample Heat Transfer over Flat Plate 

NTER M- >/ 

LAUNCH SERVICES PROGRAM | 

Lx 


• Heat Transfer Correlation Uncertainty 
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xample Heat Transfer over Flat Plate j 

IENTER Mm ) 

LAUNCH SERVICES 

• _ • I • _ • v^ 


Plug in Partial Derivatives 


c 


Seban & Doughty 

0.0236 

Jakob 

0.024 

Sugawara 

0.023 

Fundamentals of Heat and Mass 


Transfer 

0.0296 



c middle 

0.0263 

c uncert (random) 

0.0033 



Variable 

Bias 

Velocity, V 

3% 

Density, rho 

3% 

Thermal Conductivity, k 

3% 

Viscosity, mu 

3% 
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4CVfcp 
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xample Heat Transfer over Flat Plate, 

•NTER ) 


Numerically Evaluating (Traditional): 
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Heat Transfer Coefficient 


1 

i. : 


ni 



5 



2 I I I I I I I I I 

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 

Position (m) 
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Uncertainty in Heat Transfer Coefficient 




Proposed Methodology using CFD 
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CFD Uncertainty Cases 

1 

Coarse Grid 

2 

Medium Grid 

3 

Fine Grid 

4 

Velocity Low 

5 

Velocity High 

6 

Density Low 

7 

Density High 

8 

Thermal Conductivity High 

9 

Thermal Conductivity Low 

10 

Viscosity Low 

11 

Viscosity High 

12 

SA Turbulence Model 

13 

kwSST Turbulence Model 



U h 



‘ih (& (O' ‘ib (& s i) 

(O' ’■1)^00^ 


+ 


+ 


2 
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JOHN f KENNEDY SPACE CENTER 


• Results for proposed methodology 



Heat Transfer Coefficient 


O h nominal CFD 
+ hmedgridCFD 



i 5 i i i i i i i i i 

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 

Position (m) 


Uncertainty in Heat Transfer Coefficient 
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Average Difference in htc (W/m2K) 

Ranking 

Turbulence 

0.693102673 

1 

Grid 

0.130514851 

2 

Velocity 

0.117431782 

3 

Density 

0.117431683 

4 

k (thermal conductivity) 

0.069466139 

5 

Viscosity 

0.021837228 

6 


hteat Tran sfer Coefficien t (h ) (W frn2 K) 
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Comparison of Methods A-k 

* ~ * V 

!ES PROGRAM 

Traditional vs. Proposed 
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Heat Transfer Coefficient 


Uncertainty in Heat Transfer Coefficient 
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Comparison of Methods yw> 

* ~ * V 

'ES PROGRAM B 

Traditional vs. Proposed Average Heat Transfer 
Coefficient over Flat Plate 


— Traditional 

h avg = 2.66 +/- 0.74 [W/m2K] 

- Proposed CFD, 

h avg = 2.66 +/- 1-39 [W/m2K] 
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APS-DFD13-2013-000087 

Conclusion 



• Proposed Method Envelops the True value and uses 
only CFD Data to Estimate the Uncertainty for Heat 
Transfer over a Flat Plate 

- No Testing 


• Proposed methodology can be used to 
conservatively estimate the uncertainty in CFD 
models 
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Chapter 6: Demonstration and 
Implementation of the Proposed 
CFD Uncertainty Method for 
Spacecraft ECS Systems 
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0.75m Configuration 

3.5m Configuration 

5.5m Configuration 

ECS System Experimental Comparison 
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Spacecraft / ECS System 
AIAA-2014-0440 
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Uncertainty Calculation y^/> 

LAUNCH SERVICES P^RAM | 

Lx 


Proposed Methodology 


*-* l^val 


Uml ~ k (J U n«m 2 + “input" 

Expanding 


Input Variable 

Description 

Bias 

Grid 

3 grids considered for each configuration 


Inlet Velocity 

Boundary Condition low and high 

10% 

Outlet Pressure 

Boundary Condition low and high 

2% 

Turbulence Model 

SA, ke-realizable, kwSST 


Wall Functions 

with and without 


Rough Wall 
Function 

smooth vs. rough 


Compressibility 

incompressible vs. compressible 


Solver 

OpenFoam, Fluent, STARCCM+ 


Fluid Properties 

kinematic viscosity nu represents air [0-50-100] deg 
C 

1.36,1. 5,2. 306e- 
05 



/ ai/ 


\ Q ‘ ) B pressure ) ( ( 

\opressureJ H ) \\ 


( dv \ 2 

"5 J 7T ~ ) D velocity 

ovelocityJ * 


Bi 


) + ((a^) 


f>2 

u rho 
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dwall functions > 


( " y 

\d compressibility/ 
dV 


B 


wall functions 


p2 

D compressibility 


v 2 


)*(( 

Mf 


dV 


Bi 


dsurface roughness ) Surface roughness ^ 
/ dV \ 2 N 


d solver 


■ 


p2 

D solver 




dturbulenceJ 
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Results 0.75m Configuration jc 

NITER ° ^ > 


LAUNCH SERVICES 


Solution and Uncertainty Contour Plots 


L 


:esp 
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Solution Line Plot 


m 


z 


fcllCF 
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•stx_pbw 
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• Uncertainty Line Plot 
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Uncertainty Ranking 




• The uncertainty for each of the input variables were ranked by the non- 
dimensionalizing the difference in the results by the freestream value and 
ranking from greatest uncertainty to least uncertainty. 
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Input Variable 

Description 

Bias 

Mean 

Velocity 

Uncertainty 

(m/s) 

Mean Non- 
Dimensionalized 
Uncertainty 

Normalized 
Ranking % 

Numbered 

Ranking 

Grid 

3 grids 
considered 


1.6287 

0.0543 

13.40 

2 

Inlet Velocity 

Boundary 

Condition 

10% 

1.3115 

0.04737 

11.69 

5 

Outlet 

Pressure 

Boundary 

Condition 

2% 

1.1478 

0.0383 

9.45 

8 

Turbulence 

Model 

SA, ke- 
realizable, 
kwSST 


1.4628 

0.0488 

12.04 

4 

Wall Functions 

with and 
without 


0.8286 

0.0276 

6.81 

9 

Rough Wall 
Function 

smooth vs. 
rough 


1.5237 

0.0508 

12.53 

3 

Compressibility 

incompressible 

vs. 

compressible 


1.3128 

0.0438 

10.81 

6 

Solver 

OpenFoam, 

Fluent, 

STARCCM+ 


1.673 

0.0558 

13.77 

1 

Fluid 

Properties 

kinematic 
viscosity nu 
represents air 
[0-50-100] deg 
C 

1.36,1. 5,2. 306e- 
05 

1.1536 

0.0385 

9.50 
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Solution and Uncertainty Contour Plots 
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• Solution Line Plot 
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• Uncertainty Line Plot 
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Input Variable 

Description 

Bias 

Mean 

Velocity 

Uncertainty 

(m/s) 

Mean Non- 
Dimensionalized 
Uncertainty 

Normalized 
Ranking % 

Numbered 

Ranking 

Grid 

3 grids 
considered 


0.6829 

0.0228 

8.28 

7 

Inlet Velocity 

Boundary 

Condition 

10% 

0.7919 

0.0264 

9.59 

6 

Outlet 

Pressure 

Boundary 

Condition 

2% 

1.4606 

0.0487 

17.70 

1 

Turbulence 

Model 

SA, ke- 
realizable, 
kwSST 


1.3487 

0.045 

16.35 

2 

Wall Functions 

with and 
without 


0.6139 

0.0205 

7.45 

9 

Rough Wall 
Function 

smooth vs. 
rough 


1.0531 

0.0351 

12.75 

3 

Compressibility 

incompressible 

vs. 

compressible 


0.8252 

0.0275 

9.99 

5 

Solver 

OpenFoam, 

Fluent, 

STARCCM+ 


0.841 

0.028 

10.17 

4 

Fluid 

Properties 

kinematic 
viscosity nu 
represents air 
[0-50-100] deg 
C 

1.36,1.5,2. 306e- 
05 

0.6345 

0.0212 

7.70 
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Solution and Uncertainty Contour Plots 
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Solution Line Plot 


L 



eight_sa (m/s) 

eleven.nowalf ns (m/s) 

ftfteen_star (m/s) 

five jjhlgh (m/S) 

four_ubw (m/s) 

fourteenfluent (m/s) 

nlne_ke (m/s) 

one_coarsegrld (m/s) 

sevenjDtT^ghl (m/s) 

seventeen_nutt>w (m/s) 

stx_ptow (m/s) 

— stxteenjx/thjgh (m/s) 

— tenjcwsst (m/s) 



UCF 


University or Central Florida 




COLLEGE OF ENGINEERING WO COMF1 TER SCIENCE 


Results 5.5m 

JOHN f KENNEDY SPACE CENTER 


• Uncertainty Line Plot 
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Input Variable 

Description 

Bias 

Mean 

Velocity 

Uncertainty 

(m/s) 

Mean Non- 
Dimensionalized 
Uncertainty 

Normalized 
Ranking % 

Numbered 

Ranking 

Grid 

3 grids 
considered 


2.0203 

0.0673 

12.44 

3 

Inlet Velocity 

Boundary 

Condition 

10% 

1.6198 

0.054 

9.98 

6 

Outlet 

Pressure 

Boundary 

Condition 

2% 

2.0173 

0.0672 

12.42 

4 

Turbulence 

Model 

SA, ke- 
realizable, 
kwSST 


2.3049 

0.0768 

14.19 

1 

Wall Functions 

with and 
without 


1.4902 

0.0497 

9.18 

7 

Rough Wall 
Function 

smooth vs. 
rough 


1.4901 

0.0497 

9.18 

8 

Compressibility 

incompressible 

vs. 

compressible 


1.4256 

0.0475 

8.78 

9 

Solver 

OpenFoam, 

Fluent, 

STARCCM+ 


1.8172 

0.0606 

11.20 

5 

Fluid 

Properties 

kinematic 
viscosity nu 
represents air 
[0-50-100] deg 
C 

1.36,1.5,2. 306e- 
05 

2.05 

0.0683 

12.62 
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Kandula, M., Hammad, K., 
and Schallhorn, P., "CFD 
Validation with LDV Test Data 
for Payload/Fairing Internal 
Flow/' AIAA-2005-4910, 2005. 
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Variable 

Bias 

Velocity Inlet 

3% 

Kinematic Viscosity 
[0-100] Deg C 

[1.36, 1.50, 2.306] e-5 m2/s 

Pressure Outlet 

3% 

Turbulence 

ke-realiazable, kwsst, SA 
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Assumed Confidence Interval from Student 
distribution and CFD Uncertainty Prediction 

- 90% 



• LDV Data 

-Total of 1085 Points Measured 

-977 Points were inside the 90% CFD 
Uncertainty Methodology 

- 108 Points Outside CFD Uncertainty 
Prediction 

• 977/1085 = 0.90046 

• ~90% 
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Recommendation 
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• Proper validation with experimental data should be 
used to verify ECS impingement requirements 

• This research proposes a CFD uncertainty 
methodology when experimental data is unavailable 
and unobtainable 

• Couples Student-T Distribution to the number of CFD 
models and input parameters 

• All input parameters considered had the same order of 
magnitude uncertainty 
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Chapter 7: Conclusions and Future 
Work 
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• Proper validation with experimental data should be 
used when possible 

• This research proposes a CFD uncertainty 
methodology when experimental data is unavailable 
and unobtainable 

• Couples Student-T Distribution to the number of CFD 
models and input parameters 

• Methodology proved accurate for: 

• Fully Developed Laminar Flow between Parallel Plates 

• Heat Transfer over a Flat Plate 

• Spacecraft / Fairing Environmental Control Systems 
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Future Work 
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• Run Experimental Configurations to further proVe 
methodology 

• Evaluate which models are most realistic 

• Try to reduce conservatism in proposed methodology 
(if possible) 

• Expand Method beyond internal, low-speed, 
incompressible 

• Other Flow Regimes: External, Compressible, Unsteady 

• Expand Beyond Fluid Dynamics and Heat Transfer 
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Summary 



• "Uncertainty (of measurement) - parameter, 
associated with the result of a measurement, 
that characterizes the dispersion of values that 
could be reasonably attributed to the the 
quantity intended to be measured" - 
International Vocabulary of Basic and General 
Terms in Metrology 


• Replace 

— Measurements Simulation 
— Measured -> Simulated 
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Thank You 
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